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Abstract: This report investigates the optimal design of event-triggered estimation for first- 
order linear stochastic systems. The problem is posed as a two-player team problem with a 
partially nested information pattern. The two players are given by an estimator and an event- 
trigger. The event-trigger has full state information and decides, whether the estimator shall 
obtain the current state information by transmitting it through a resource constrained channel. 
The objective is to find an optimal trade-off between the mean squared estimation error and the 
expected transmission rate. The proposed iterative algorithm alternates between optimizing one 
player while fixing the other player. It is shown that the solution of the algorithm converges to 
a linear predictor and a symmetric threshold policy, if the densities of the initial state and the 
noise variables are even and radially decreasing functions. This is achieved by considering the 
iterative algorithm as a dynamical system and apply Lyapunov methods to show that it is globally 
asymptotically stable. The effectiveness of the approach is illustrated on a numerical example. In 
case of a multimodal distribution of the noise variables a significant performance improvement 
can be achieved compared to a separate design that assumes a linear prediction and a symmetric 
threshold policy. 



1 INTRODUCTION 

In contrast to periodic estimation, where measure- 
ments are sampled within equidistant time-intervals, 
an event-triggered estimator receives measurement up- 
dates in an asynchronous fashion. Event-triggered 
sampling is also referred to as adaptive sampling 
in (TJ, Lebesgue sampling in [2 1 and dead-band con- 
trol in 0, |4). The event-trigger is a preprocess- 
ing unit situated at the sensor which decides upon its 
available information, whether to update the estima- 
tor with current information. Event-triggered sam- 
pling schemes for estimation are very promising in 
the context of networked control systems, where es- 
timator and plant are spatially distributed and com- 



*This is an extended version of the paper 'An Iterative Algo- 
rithm for Optimal Event-Triggered Estimation' that appears in the 
proceedings of the ADHS 2012. 



munication is a sparse resource. Examples for such 
networked control systems are given by sensor net- 
works, multi-robot systems and distributed power gen- 
eration networks. The work in [2| and [1 1 showed that 
event-triggered sampling outperforms periodic sam- 
pling with respect to the state estimation error of a 
first-order linear system in the presence of two dif- 
ferent communication constraints. In [Qj, the com- 
munication constraint is induced by limiting the num- 
ber of transmissions during a finite interval, whereas 
the work in |2) limits the average transmission rate. 
Differing to these approaches, we extend the standard 
minimum mean square estimator problem by an addi- 
tional communication penalty to reflect the communi- 
cation constraint in the optimization problem. A simi- 
lar problem is also studied in [5 1 and [6 1. 

Opposed to the aforementioned work which either 
fixes the estimator, such as EIUEI or computes the 
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estimator from the choice of the event-trigger, such 
as IS), we aim at the joint optimal design of the es- 
timator and the event-trigger. Therefore, we formu- 
late a two-player team problem with a nested informa- 
tion pattern, where the players are given by the event- 
trigger and the estimator. The joint design is motivated 
by the fact that the choice of the event-trigger may sig- 
nificantly influence the form of the optimal estimator. 

The contribution of this report is two-fold. First, 
it develops an iterative method for the joint design 
of event-trigger and estimator for first-order stochas- 
tic systems with arbitrary distributions. The algorithm 
iteratively alternates between optimizing one player 
while fixing the other player. Similar iterative proce- 
dures are shown to be very promising methods for cal- 
culating optimal policies for team problems with non- 
classical information patterns, as studied by [7| for the 
Witsenhausen counterexample or by [8| for the joint 
optimization of paging and registration policies. It 
turns out that the proposed iterative method can yield a 
remarkable decrease of the overall cost compared to a 
design where the estimator is designed independently 
of the event-trigger. In such independent design, the 
optimal estimator takes the form of a linear predictor 
that assumes that transmission instants are statistically 
independent of the state, whereas the optimal event- 
trigger is a even threshold function of the estimation 
error. In the following, even and symmetric refer to 
the same meaning. 

Second, it is shown that the solution of the algorithm 
converges to the independent design, when the densi- 
ties of the initial state and the noise variables are sym- 
metric and unimodal functions. This result coincides 
with results obtained in [6|, which uses majorization 
theory and rearrangement inequalities to show that 
there always exists a symmetric threshold policiy that 
outperforms an arbitrary event-triggering law. In fact, 
we show that symmetric threshold policies are opti- 
mal by analyzing the asymptotic behavior of the pro- 
posed iterative procedure. Therefore, our approach can 
be viewed as an alternative line of proof to show that 
symmetric policies are optimal under the aforemen- 
tioned assumptions. On the other hand, it turns out 
that symmetry of the densities is not sufficient to show 
that the separate design is optimal. Numerical simu- 
lations indicate significant improvements, when noise 
densities are symmetric but multimodal. In fact, sim- 
ulations indicate a substantial improvement of our ap- 
proach compared to an independent design in case of 
a bimodal noise distributions. 

The remainder of this report is organized into four 
sections. In section|2j we introduce the stochastic sys- 
tem model and describe the problem setting. Section|3] 



contains the main results of this report and studies the 
joint design of event-trigger and estimator. In sec- 
tion@l numerical simulations are conducted to validate 
the proposed method. 

Notation. The expectation operator is denoted 
by £/[•] and the conditional expectation is denoted 
by E/[-|-], where the underlying probability measure 
P/ is parameterized by the policy /. The variable X k 
denotes the sequence of variables [xo, . . . , Xk] and X l k 
denotes the sequence [xk, ■ ■ ■ , x{\. The indicator func- 
tion is denoted by 1a(x) taking a value of 1 if x e A 
and otherwise. The complement of a set A is denoted 
by A c . The maximum norm of a vector x £ K™ is de- 
noted by |aj|oo. The convolution of two real- valued 
function / and g is denoted by / * g. 



2 PROBLEM FORMULATION 

We consider the following stochastic scalar discrete- 
time process V driven by noise wj. 



Xk+i = ax k +w k , 



(1) 



where net- {0}. The system noise Wk takes val- 
ues in R and is an i.i.d. (independent identically dis- 
tributed) random variable described by the probability 
density function <fi w , which is zero-mean and has finite 
variance. The initial state, xo is statistically indepen- 
dent of Wk and is described by density function <f) X(l , 
which has a mean xo and a finite variance. System pa- 
rameters and statistics are known to the event-trigger 
and estimator. 

The system model is illustrated in Fig. Q] The pro- 
cess V outputs the state Xk- The event- trigger £ de- 
cides upon its available information, whether or not to 
transmit the current state to the remote state estimator 
S. We define the output of the event-trigger as 



S k = 



1 update Xk sent 
otherwise 



The channel J\f can be viewed as a (^-controlled era- 
sure channel whose outputs are described by 



Zk 




(2) 



where is the erasure symbol. As it will be useful for 
subsequent analysis, we define the last update time r^ 



Tfe 



max{K|<5 K = 1, K < k} 



(3) 
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with Tfc = — 1, if no transmissions have occurred prior 
to k. The variable t^ can be described by the follow- 
ing 4 -controlled difference equation 



Tfc+l 



n 



4 = 1 

4 = 



TO = -1. 



(4) 



Admissible event-triggers are given by mappings of 
their past history to 

Sk = fk(X k ), k = Q,...,N-l. 

The state estimator S outputs the state estimate x k and 
is given by mappings g k defined by 



x k =g k (Z k ), fc = 0,. 



,/V-l. 



The design objective is to jointly design the event- 
trigger / = [/ ,...,/jv-i] and the estimator g = 
[go, ... , ffjv-i] m at minimize cost J. 



-f,g 



'JV-l 

E 

.fe=0 



\xk - x k \ 2 + \8 k 



(5) 



The per-stage cost of J is composed of the squared 
estimation error \x k — x k \\ and a communication 
penalty \8 k . The weight A determines the amount of 
penalizing transmissions over the channel J\f. 



V 



3 'A: 




Figure 1 : System model of the networked control sys- 
tem with plant V, event-trigger £, state estimator S 
and communication channel J\f. 



3 JOINT DESIGN OF EVENT- 
TRIGGER AND ESTIMATOR 

3.1 Preliminaries 

We begin with a characterization of the optimal esti- 
mator. 

Lemma 1. For any event-trigger f, the optimal state 
estimator g* is given by the least squares estimator 

x k = g* k {Z k ) = Ef[x k \Z k }, k = 0,...,N-l. 



Proof. Fix an arbitrary event-trigger /. The commu- 
nication penalty term E/ J2k=o ^k is then con- 
stant and can be omitted from the optimization. In 
the remaining estimation problem the mean squared 



error E 



is to be minimized. The 



L,fe=0 \ x k-Xk\ 

optimal solution for this problem is given by the least 
squares estimator E/[xfc|Z fc ], [9|. This completes the 
proof. □ 

In the following, we define the linear predictor x)f 
by the following recursion 



<-fc+i 




(6) 



with x}f = xq- 



Remark 1. The linear predictor can be regarded as 
the optimal estimator, when having no information 
about the choice of the event-trigger f and assuming 
that transmission instances are statistically indepen- 
dent of the state evolution. This also implies that the 
linear predictor is optimal in the case, when transmis- 
sion instances are selected in advance. 

Similar to EQlJ], let us rewrite the optimization 
problem by defining 

efc = «fc - o^Ld fc = 1, ...,N- 1 

and eo = W-i, where we define W-i = xo — So- The 
variable e k defines our new state to be estimated and 
follows the recursion 

efe+i = h k (e kl S kl w k ) = (1 - 8 k )ae k +w k . (7) 

Further, we define e k to be the least squares esti- 
mate E[efe|Z fe ], where z k is defined accordingly as 



Zk 



The next lemma gives us further insights into the 
structure of e k . 

Lemma 2. Let the event-trigger f be fixed. Then, the 
least squares estimate of e k is given by 




e-k 



e k 4 = 1 

a k {T k ) 4 = 



where r k is defined by Eq. (0 and a k {r k ) is defined 
by 



a k (T k ) = Ej 



fc-l 








- 


E« fe ~ 


1 w l \5 Th+1 -- 


= 0,. 


• ,4 


= . 


l = T k 








(8) 
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Proof. Clearly, we have e& = efc for S k = 1, 
as efe E Z k . For <5fc = 0, r k is a sufficient statistics 
for efc. The mapping a^ is determined by applying re- 
cursively © with e Tfc +i = w rfc . This completes the 
proof. □ 

The function a in Lemma|2]can be interpreted as a 
bias term to improve the state estimate by incorporat- 
ing additional information 8 Tk +\ = ■ ■ ■ = 5k = at 
time k. 

Rather than regarding a as a function of k and th, 
we will interpret a as a vector in Ri JV ( Ar + 1 ) by rein- 
dexing its entries appropriately. 

It is straightforward to see that the estimation er- 
ror efe — efc and Xk — Xk are identical random vari- 
ables for a fixed event-trigger /, as efc corresponds to 
a translatory coordinate transformation of Xk shifted 
by —ax]f_ l which is known since the sequence 5 k ~ 1 
is measurable with respect to Z , Therefore, our ini- 
tial optimization problem with cost function J can be 
rewritten as 



min E t 

f 



JV-l 

E 

fc=0 



(1 - 4)|efc - a k (T k )\ 2 + XS k 



(9) 



It can be observed that the running cost reduces to A 
and is therefore independent of the current a k in the 
case 5k = 1. Because of the introduction of the state 
efc, the event-trigger / is given by a mapping from E k 
to {0, 1}. Since there always exists a bijection from 
X k to E given the variables So, . . . , S^-x, this change 
of variables does not put any restrictions on the further 
analysis keeping in mind that any policy expressed in 
E k can also be written as a function in X k . 



3.2 Iterative procedure 

What prevents a further study of the optimization 
problem (0 is the fact that the value a k at r k depends 
on the particular policy / chosen up to time k. There- 
fore, methods like dynamic programming are not di- 
rectly applicable to solve ©. In order to overcome this 
burden, we relax optimization problem (|9j by consid- 
ering the variable a k as a new decision variable being 
a function of r k . Then, the optimization problem is 
given by 



min J 

/.a 



(10) 



with 



N-l 



^(1- S k )\e k - a k {r k )\ 2 + X5 k 



k=0 



(ID 



The optimization problem (TTOb enlarges the set of pos- 
sible solutions compared to optimization problem ©, 
because it omits the constraint for a given by ©. By 
considering optimization problem ([ToV we are able 
to specify the structure of the optimal event-trigger, 
which is given by the following lemma. 

Lemma 3. Let a be fixed. Then, for 

all k € {0, . . . , N — 1} the variables e k and T k 
are a sufficient statistics for the optimal event-trigger 
ffc. 

Proof. The evolution of the pair (e k ,r k ) can be re- 
garded as a 5k -controlled Markov process defined by 
dUi and Q. The running cost of J at time k is a 
function of the pair (e k ,r k ), input S k and noise w k . 
By |9|, this problem can be solved by dynamic pro- 
gramming with (efc, Tfc) being the state, which is a suf- 
ficient statistics of the optimal solution f k . This com- 
pletes the proof. □ 

Lemma [5] implies that the optimal event-trigger is a 
function of efc and r k . It can be observed that for a 
fixed event-trigger /, the optimal map a can be calcu- 
lated by Eq. ((H). On the other hand, for any fixed map 
a, the optimal event-trigger / can be calculated by dy- 
namic programming. We therefore define the running 
cost and the Bellman operator as follows 

Cfc fc (efc,Tfc,(5fc) = (1 -<5 fe )|efc - a k (T k )\ 2 + XS k 

7T=Jfc + i(-) = 
= min c fc " fc (-,4) + E[Jfc + i(efc+i,Tfc + i)|-,4] 

<5fc6{0,l} 

The value function J k being a function of the aug- 
mented state (efc, Tfc) is determined by recursive ap- 
plication of the Bellman equation given by 



Jfc — 71 k Jfc+i 



with Jm = 0, where the argument in the minimization 
yields the optimal event-trigger / and we have 

J(/,a) = E / [J (eo,-l)]. 

This observation motivates us to propose the follow- 
ing iterative procedure sketched in Fig. [2] which alter- 
nates between optimizing / while fixing policy a and 
vice versa. Algorithm[T]describes the iterative proce- 
dure. With slight abuse of notation, we declared r k as 
a second subscript instead of an argument of a k . 

As the cost J decreases or is at least kept con- 
stant in each step of the iteration, the sequence 
[(/°, a ), (Z 1 , a 1 ), . . .] produces a non-increasing 
succession of costs J. 
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Algorithm 1 Iterative procedure to calculate (/, a) 



Require: a° k Tk e 

-l,...,fe-l 
1: i«-0 



k = 0,...,N - 1,7* = 



repeat 

k = N, J N = 
repeat 

k-t-k-1 

Jk <— T k k Jk+1 

fk( e k,Tk) G argmin,5 fce04 c^ fc (e fc ,T fe ,4) 

+ E[Jfc + i(efc + i ! Tfc + i)|efc,T)b,(5fc] 

until fc = 



j «— i + 1 
until convergence 



J=Tfr 



^K+i = o 




estimator <S 



event-trigger £ 




Figure 2: Iterative scheme to calculate event-trigger £ 
and estimator S. 



In the following subsection, we are interested in the 
convergence properties of the proposed iterative algo- 
rithm for symmetric unimodal distributions. 



3.3 Symmetric unimodal distributions 

In the following, we consider the iterative procedure 
described in previous subsection as a discrete-time dy- 
namical system and consider a as the state. By using 
Lyapunov stability theory we show that a = is a 
globally asymptotically stable equilibrium point, when 
initial state eo and the noise process {wk} has a sym- 
metric unimodal distribution. The next lemma finds a 
potential equilibrium point only by assuming symmet- 
ric distributions. 

Lemma 4. Let the initial state eo and the noise pro- 
cess {wk} have symmetric distributions. Then a* = 
is afixpoint of the Algorithm^ The policy of the event- 
trigger f* that corresponds to a* is an even mapping 
of ek and independent of Tk for k = 0, . . . ,N — 1. 

Proof. Let us choose the map a to be for all k and 



all r in the initialization of Algorithm Q] The cost 
function J reduces then to 



J(/,a°) = E / 



N-X 

£ 

Lfc=o 



(i-4)N 



XSi 



where ek evolves by recursion (0. Therefore, the 
resulting optimal /£ is only a function of ek for 
all k = 0, . . . , N — 1. In the following, we first show 
that the application of the Bellman operator T k ° pre- 
serves symmetry of the value function Jk+i for any 
k. Given an even value function Jk+i, the conditional 
expectation E [J k +i(ek+i, Tk+i)\-, 8k] preserves sym- 
metry for both 5k = and 8k — 1. Adding the cost 
Cfc(-, 8k) also preserves symmetry, because the sum of 
two even functions is again even. Taking the pointwise 
minimum of two even functions yields an even func- 
tion. Therefore, an even function remains even after 
application of the Bellman operator. As Jjy = is an 
even function, it follows by induction that every value 
function Jk is even for k £ {0, . . . , N — 1}. This im- 
plies that the /° resulting in the first iteration step from 



Algorithm[T]is an even mapping of ek, if a" 



0. 



Next, we calculate a assuming /£ being an even 
function of e* for k £ {0, . . . , N — 1}. Let <f> ek \ T be 
defined as the density function of the conditional prob- 
ability distribution of e^ given Tk and 8k = 0, when 
using event- trigger /°. The definition of <j> ek \ T yields 
the following calculation of a\ 



l k,T 



cf> ek \ T (e)de 



For k — 0, <pe k \r is determined by truncating the den- 
sity function <fr eo of the initial state eo at all (e, r), 
where /q takes a value of 1 and by normalizing the 
resulting function, i.e. 



0e o |r(e) 



& (e)-(l-/ °(e,T)) 

/ eGR <Me)-(l-/o°(e,T))de- 



(12) 



Since c/) eo and /q are even functions, we conclude that 
4> eo \T is even an d therefore we have a\ _ 1 =0. Along 
the same lines, we can show that cj) ek \k-x is even and 
a l,k-i = for fe e {1, . . . , iV — 1} by replacing <j> eQ 
with <f) w in (fT2l . For a constant r, the conditional 
density function cj) ek i T evolves by the recursion 



^e fc+1 |r(e) = 

(R^(^)*^)(e)-(l-/£(e,T)) 
J eeR (R^ fc |r(^) * 4hv)(e) ■ (1 - / fc °(e,r))de' 

It can be observed that this recursion preserves sym- 
metry of the conditional density function 4>e k \T, as /° 
is an even function. Therefore, we have shown that 
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a* = is a fixpoint of Algorithm Q] which completes 
the proof. 

□ 



In above lemma, the distributions need not to be uni- 
modal, but only symmetry properties are required. A 
natural question arising from Lemma |4]is whether the 
fixpoint at is a stable and unique fixpoint. This ques- 
tion is partly answered in the following Theorem by 
adding the assumption that the distributions are uni- 
modal. 

Theorem 1. Let the initial state e$ and the noise pro- 
cess {wk} have symmetric and unimodal distributions. 
Then, a* = is a globally asymptotically stable fix- 
point of Algorithm^ 
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Figure 3: Various bimodal/unimodal density functions 
with zero-mean and identical variance of 1 composed 
of two Gaussian kernels shifted by ±/z. 

4 NUMERICAL VALIDATION 



The proof can be found in the appendix. 

As the iterative Algorithm Q] produces a sequence 
of pairs (f' l ,a l ) whose costs are non-increasing with 
increasing i, we conclude that is the optimal choice 
for a, when noise distributions are symmetric and uni- 
modal according to Theorem Q] The optimal state es- 
timator of Xk is then given by the linear predictor in 
© and is therefore independent of the choice of the 
event-trigger /. The distribution of the initial state xq 
must be also symmetric and unimodal, but its mean So 
can be chosen arbitrarily. Hence, the symmetry axis of 
the distribution of xo need not to be at zero. In order 
to determine the optimal /*, dynamic programming 
must only be applied once with a = 0. Therefore, the 
joint design approach in the case of symmetric den- 
sities can be considered as an independent design of 
event-trigger and estimator. 

This result is in accordance with [6] and constitutes 
an alternative way by analyzing the asymptotic be- 
havior of Algorithm Q] to prove that symmetric event- 
triggering laws are optimal in the presence of symmet- 
ric unimodal distributions. Moreover, the iterative al- 
gorithm may be applied to arbitrary distributions. Al- 
though a = is a fix point of the Algorithm Q] by 
Lemma [4] assuming symmetric density functions, the 
next section shows that an independent approach given 
by a = can be outperformed by Algorithm Q]by al- 
most 50%. Hence, we can conclude that symmetry of 
the densities is not sufficient to show that the indepen- 
dent design is optimal. Therefore, additional assump- 
tions are required to show that the independent design 
is optimal. In the case of Theorem[T]such requirement 
is given by the unimodality assumption of the density 
functions. 



This subsection intends to outline the benefits of the 
proposed iterative algorithm by numerical examples. 
Besides, it validates the obtained results for unimodal 
noise distributions. We compare the iterative algo- 
rithm with the optimal symmetric event-trigger having 
a linear predictor, i.e. assuming a = 0. Suppose the 
process defined by (fl]i with a = 1, a communication 
penalty A = 0.5 and the distribution of the initial state 
and the system noise are identical and defined by the 
density function <j> w 



<j> w {n,o) = ~4>tf{p.,o) + -c/w(-/x,ct) 



with 



<t>N(jJ>,°) 



1 



\/27rcr 2 

In the special case of [i — 0, we retrieve the normal 
distribution. In order to facilitate comparability be- 
tween different distributions, we choose /j£ [0,1) and 
set 

that yields an identical variance of 1 for all /i e [0, 1). 
In the limit u, — > 1, the noise process degrades to a 
Bernoulli process taking discrete values {—1,1} with 
probability i. Various density functions for different 
// are sketched in Fig. [3] 

We observe that for /i < 0.8 the peaks of the bi- 
modal density function are less distinctive. There- 
fore, we can not expect that large gains of the itera- 
tive procedure can be attained compared with the op- 
timal symmetric solution for fi < 0.8. A performance 
comparison of the iterative procedure and the optimal 
symmetric event-trigger is drawn in Fig. |4]for a hori- 
zon TV = 10 and various /i. The initialization for the 
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timal symmetric event-trigger is given by /(xq) = 
1{ [-0.7,0.7] }•(#())• The event-trigger and estimator re- 
sulting from the iterative procedure have therefore an 
implicit agreement, if no state update is sent over the 
resource-constrained channel. In that case, no trans- 
mission indicates the estimator that the state xq is sit- 
uated at the right peak resulting in the estimate cto. 
In contrast to that, the linear predictor defined in (|6), 
which is optimal for the symmetric event-trigger, is in- 
dependent to the choice of the threshold of the sym- 
metric event-trigger and the noise-distribution. 



degree of unimodality 1- n 



Figure 4: Performance comparison for a horizon N = 
10. The degree of unimodality 1 — /i (1 for zero-mean 
Gaussian and for Bernoulli process with discrete pa- 
rameters in {-1,1}) is drawn on a logarithmic scale. 
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Figure 5: Event-trigger policy / (scaled by 0.007) 
resulting from the iterative Algorithm [TJ with initial 
noise distribution <f> w , \x = 0.95, horizon N = 1 
and initial choice ckq = 0.1. The algorithm con- 
verges to ao = 0.95 and an asymmetric event- 
trigger f(x ) = 1{[0.25,0.65]}=(»0)- 



iterative procedure is chosen to be a = 0.1. As ex- 
pected the costs are almost identical for u, <E [0, 0.8]. 
This also validates Theorem [TJ since <f> w is unimodal 
for sufficient small choice of /z. For \x > 0.8 a 
rapid performance improvement can be observed. In 
the limit \x —¥ 1, the costs are reduced by a fac- 
tor of 45% by the iterative procedure compared with 
the optimal symmetric event-trigger. This may seem 
surprising, because the cost function as well as the 
noise distribution are all even functions. Fig. [5]gives 
an illustrative explanation of such significant perfor- 
mance improvement for N = 1 and /i = 0.95. With 
an initial value a{] = 0.1, the iterative algorithm con- 
verges toao = 0.95 and an asymmetric event- trigger 
policy f(x ) = l{[o.25,i.65]}' ! (^o) ! whereas the op- 



5 CONCLUSIONS 

By considering the joint optimal design of state es- 
timator and event-trigger as a two-player problem, 
we were able to develop an efficient iterative algo- 
rithm, which alternate between optimizing the estima- 
tor while fixing the event-trigger and vice versa. The 
iterative method shows special properties in the case 
of unimodal and symmetric distributions of the uncer- 
tainty. In this situation it is shown that the optimal 
event-triggered estimator can be obtained by a sepa- 
rate design and is given by a linear predictor and a 
symmetric threshold policy. This result is along pre- 
vious results and offers an alternative line of proof for 
showing that such separate design is optimal in case of 
symmetric unimodal distributions. 

In the case of symmetric and bimodal distribu- 
tions, the iterative procedure offers a systematic 
method, which leads surprisingly to asymmetric event- 
triggers and biased estimators that outperform sym- 
metric threshold policies. 

Similar properties of the iterative method are likely 
to hold as well in the case of multidimensional sys- 
tems and are a subject of current investigations. Fur- 
ther research also investigates to extend the proposed 
iterative procedure to a sensor network setting, where 
various spatially distributed sensors shall find a com- 
mon state estimate through exchanging information 
through a common digital network. 
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A Proof of Theorem 3] 

Proof. First, we define the following time-variant 
transformations of e k and a kyTk by 

1 



Vk 



: e k , k = 0,...,N-l, 



1 



(3 k ,r k = —a k ,r k , k = 0,...,N-l, 

r k = -l,...,k - 1. 

By this transformation, the running cost and the Bell- 
man operator are defined by 

c P k k (y k ,T k ,6 k ) = (1 - S k )a 2k \y k - f3 k , Tk \ 2 + XS k 



-Pk 



tfiht 



T k Pk J k+ i(-)= min cf (•,&)- 



E J k+1 (y k+ll T k+1 )\-,5 k 



The optimization problem ( TTOb can then be restated by 
replacing J with J defined by 



J(f,P) 



-I 



N-l 

Y^ cl k {y kl T k ,8 k ) 
fe=o 



The event- trigger f k is a function of y k and r k , where 
y k evolves by 

Vk+i = (1 - Sk)yk + Vk, Vo = e 

with v k = -jrw k and the evolution of r k is given 
by (|4j. It is easy to see that the distribution of v k is 
again unimodal and symmetric. In the following, we 
adapt Algorithm[T]to the transformed system. We con- 
sider (3 l as a vector in ~R2 N ( N + 1 ') that evolves by the 
procedure defined by (fLTt . By this view, j3 l is the state 
of a non-linear time-invariant discrete-time system de- 
scribed by 



f = argmin f J(/,/3 i ) 



($r = E 



/* 



■fc-1 



2jvi|<Sr+l 



0, . . . , 8 k 



(13) 



In order to analyze the asymptotic behavior with in- 
creasing i, we introduce the following Lyapunov can- 
didate V(l3 l ) defined by 

V((3 l ) = \PU 

In order to show that V(f3 l ) is decreasing with respect 
to i, we establish several auxiliary results. For nota- 
tional convenience, let /3^ be defined as 

PL = W l U 

What we want to show first is that for every event- 
trigger f 1 resulting from (Tl~3T > for a given j3 l , we have 



fUPl o + A,r)=0 
VA>0,fc = 0, . 



,N- 



fk\P oo ~ 


A 


t) 


= 


,T = -1, 




,k 


-1. 
(14) 



The validity of above implication is shown by induc- 
tion starting with k = N—l. We fix a f3 l and apply dy- 
namic programming to obtain /\ Because of Jm = 0, 
the value function Jn-i is then given by 



Jn-i(v,t) 



zPn-i 



S£{0,1] 



■-N- 



?(V,T,8) 



Note that the running cost exhibits the symmetry prop- 
erty 

cf(/3| iT + A,r,5) = cf(/3| )T -A 1 r,<5) ! 
VAeM,(5e{0,l} 
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with r = — 1, . . . , fc — 1 and the monotonicity property 

< Ai < A 2 

=» cf(^ r + A 1 ,r,<5)<c?(4 >T + A 2 ,r,5) 

for 5 £ {0, 1} and r = — 1, . . . , fc — 1. Both properties 
are preserved after taking the minimum over 5 imply- 
ing that they are also valid for Jat-i. Therefore, we 
obtain 



■/*_!(/&, + A, r)> J N -i(Pi 



A,r) 



VA>0 
(15) 



with r = -1, . . . , N - 1. For A < /%, - /3* T , in- 
equality (fT~5T > is valid due to the monotonicity property 
of Jjv-i- In case of A > /3^ — /3jf. T , we have 

= J N - 1 (P 00 -[31 t + (31 t -A,t) 

= j N ^ l (pi iT +(Pi T -p i 00 +A,T) 

< Jjv-iO^+A.r). 

The second equality is due to the symmetry property 
and the inequality is due to the monotonicity property 

as 

4 iT < /3| iT + G8ji, T - & + A) < & + A. 

By knowing that the value function Jn-i = A is con- 
stant for all pairs (y, r), when 5n-i = 1, we have 

&_i(&-A,t) = 1 

=*■ A = J^_i(/4-A,t)<J^_i(/3J + A,t) 

=> Jjv_i(/3^H-A,t) = A 

=* /^-i(^ + A,r) = l 

Next, we show that by applying the Bellman operator 
will preserve the inequality given by (1151 , Assume, we 
have 

J fc+1 (/3L + A, r) > J fc+ i(/3^ - A, r), VA > 

(16) 



with r = — 1 , 
([Tol l implies 



1. We want to show statement 



J fc (/^+A,r)> JfcO^-A.r), VA > (17) 
with t = — 1, . . . , ft — 1, The Bellman equation is 

For all pairs (y, r), where the argument of the mini- 
mization in 71 yields 5k — 1, Jfe is constant. This 



also implies that Jk takes its maximum for these pairs. 
In the following, we are interested in outcomes for Jk 
in case of 5k = 0. Along the same lines as for Jn-i> 
we obtain for the running cost c k k 

8f i (^ 00 + A,r,*)>af i (/3 i 00 -A,r,*), 

VAeM,<5e {0, 1} (18) 

with t = — 1, . . . , fc — 1. We rewrite Ju+i to 

fREN 

'fe+i 



t _ tSYM i 9REM 

■Jk+1 — Jk+l "+" J fc+1 



with 



jSYM ( ) = | j w(!/,t) y</3, 

fc+1 1j fc+1 (^ + (^-j/),r) y>/3, 



J^(y,r) = J k+l (y,r)-4lf(y,r) 
By the assumption ( [To*] ), we have 

'=0 y<#, 



■E3W) 



>0 y>/3, 



(19) 
(20) 



(21) 



Taking the expectation of Jk+i given 5k, yt and 
Tfe, gives either a constant function over (yk,Tk) for 
5fe = 1 or is given by convolution with the density 
function of Vk for 5k — denoted by <j). By assump- 
tion the density function <fi is symmetric and unimodal. 
By linearity of the convolution operator, we follow 



Jk+l\-,Tk,5k = 1 



REM/ 



= r k l7(;T k )*cf> + JkT(->T k )*<t> (22) 



For the first term of (1221 . we observe that symmetry is 
preserved, i.e., 

(jf™(.,r fc )*4>)(^+A) 

= (J fc S ^(-,T fc W)(/4-A) (23) 

for A £ R. On the other hand due to (ED and 

0(y-(/4+A)) > <My-(/^-A)) ; A > 0,y > /4 

we have for any A > 

(j^(-,T fe )*<£)04 + A)> 

>(J^(-,r fc )*^)(^-A). (24) 

Summing up the terms and taking the minimum to ob- 
tain Jk, we obtain statement ( TPTT i by using (fT8l , J23l 
and ( f24b . By induction, statement ( TP71 ) is valid for 
all fc = 0, . . . , N — 1. Along the same lines as for 
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N — 1, we follow (fl4] i from statement ( TT7| >. Equiv- 
alently to (fl4l >. it can be showed that 

/*(-&- A, r) = 

=* /*(-& + A, r)=0 
VA>0,fc = 0,...,iV-l,T = -l,...,fe-l. 

Let cf> 1 I be defined as the density function of the 
conditional probability distribution of %jk given Tfc and 
5k = 0, when using event-trigger /*. The definition of 
<j) 1 , yields the following calculation of Z?^ 1 



o»+J. _ 

Pfc,T — 



ySR 



y ■ 4>l k \r{y)dy 



By assuming an event-trigger /' that satisfies state- 
ment (TPfl i. we show inductively that 

0; fc|r (/3J )O + A)<0; fc|r (/3^-A), VA>0, 

k = 0,...,N-l,T = -l,...,fc- 1. 

(25) 

For fc = 0, </>* . is calculated by truncating the den- 
sity function <fi yo of the initial state yo at all (y, r), 
where /£ takes a value of 1 and by normalizing the 
resulting function, i.e. 



<K \r(y) 



K(y)-(^-fo(y,T)) 

fy&tvotv) • 0- - fo(v>T))dy' 



As 



) yo is an even and unimodal function, we have 

A), 
= 0. 



A>0,/|(^ + A,r) 



For all (y, r) with fKP^ + A, r) — 1, we have 

0; o|r (/3^+A)=O, 



which trivially validates inequality (1251 1. Similarly 
as for k = and r = — 1, we can prove the validity 
of (|25T> for k € {1, N— 1} and r = fc— 1 by replacing 
the density function yo by the density function Ufc _ 1 
of the noise variable Ufe_i. By assuming that inequal- 
ity d25l l is satisfied for time step fc, we prove that (f25l 
holds for fc + 1 for an arbitrary fc G {0, . . . , N— 2} and 
fixed t e { — 1, • ■ • , k — 1}. For a fixed t, the density 
function </>* i T (y) can be calculated by the recursion 






ilk 



| T *^J(v)-(l-/St(tf J r)) 



^| T *0»J(v)-(l-/St(V.T))d tf " 

(26) 



As having already been observed for Jk+i, the convo- 
lution of 0* | with 4> Vk preserves the inequality (|25V 
With the same arguments as for k — 0, we follow that 

4 IT (/4 + a)<<| T (/4-a), 

A>0 



implies 



Vk + 



i|T (^+A)< 



A>0, 



which concludes the induction. Inequality d25l l im- 
plies that j3 1 ^ < (3^. Similarly, it can be showed 
that (3^ > — /3^. In fact, it is straight forward to see 
that the inequalities are strict for all (3^ ^ and there- 
fore the Lyapunov candidate V decreases with increas- 
ing i for all j3 ^ 0. Hence, the iterative procedure de- 
fined in (Tl3T > converges to for any initial condition of 
P. By transforming /3 back into the initial state space 
system, we can conclude the proof. □ 



